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Summary of Review 

The South Carolina Policy Council Education Foundation report, How School Choice 
Can Create Jobs for South Carolina, argues that school choice, in the form of vouchers 
to attend private schools, would create significant job opportunities in five poor, rural 
counties of South Carolina. The report, however, relies almost exclusively on results of 
an earlier study that has significant limitations in its methodology and execution, render- 
ing its findings unreliable. The report also introduces questionable assumptions while 
extrapolating these findings to the five focus counties — assumptions that drive the out- 
comes but are unlikely to hold in practice. As a result of its uncritical acceptance of an 
earlier flawed study and in its introduction of additional untenable assumptions, the re- 
port offers findings that are unlikely to be valid and is of little use in informing policy- 
makers and the public about the effects of vouchers. 





Review 



I, Introduction 

A new report, How School Choice Can 
Create Jobs for South Carolina} written by 
Sven Larson and published by the South 
Carolina Poliey Council Education Founda- 
tion, contends that vouchers would produce 
signihcant economic benefits for South Car- 
olina. In particular, the report focuses on 
poorer rural counties, finding economic ben- 
efits in the form of a significant increase in 
the number of small businesses and private 
sector employment. Extrapolating results 
from a recent study finding that places offer- 
ing school vouchers witness higher rates of 
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entrepreneurship and self-employment, 
Larson contends that increased -voucher- 
based school choice” (simply called -vouch- 
ers” in this review) can be one significant 
instrument for addressing the need for great- 
er economic growth in South Carolina’s dis- 
tressed communities. 

Voucher programs, like other school reform 
efforts such as charter schools and accoun- 
tability programs, may have effects beyond 
changes in academic outcomes. In theory, 
such tangential consequences can be either 
detrimental (e.g., increasing segregation of 
students by race or income) or beneficial 
(e.g., inculcating a sense of morality and ci- 
tizenship as is sometimes argued to be the 
case for parochial private schools). This re- 
port highlights one such potential effect of 
voucher programs — on possible entrepre- 
neurial behavior of students who have used 
vouchers to attended private schools. 

On both theoretical and empirical grounds, 
such a claim seems surprising at first. Theo- 
retically, it is difficult to believe that even if 
some schools are able to instill a sense of 
competition and innovation in their students. 



such effects will be reflected later in an in- 
creased rate of self-employment rather than 
through other employment prospects. Such an 
economic boost seems particularly unlikely 
via self-employment rates at a very young age 
(ages 16-25 and ages 16-30). Further, the em- 
pirical literature suggests that while voucher 
programs can in principle inculcate a sense of 
competition, innovation and risk-taking, such 
effects are likely to be small for most schools. 
Moreover, the between-school competition 
that does occur often does not involve in- 
creased engagement in productive and innova- 
tive practices."^ Further, the introduction of 
charter schools in many inner cities has led to 
decreased enrollments in existing private 
schools — ^particularly parochial schools — 
followed by closures or consolidation.^ This is 
probably not the sort of innovation and effi- 
ciency that would stimulate local economies. 

In this context, it would have been interest- 
ing if Farson had explored the strengths and 
weaknesses of prior research, looking at new 
evidence to shed light on this important is- 
sue. However, the report covers no new 
ground and its contribution to a meaningful 
discussion of this particular aspect of vouch- 
er programs is minimal. In its uncritical ac- 
ceptance of an earlier flawed study and in its 
introduction of additional untenable assump- 
tions, the report offers findings that are un- 
likely to be valid and is of little use in in- 
forming policymakers and the public about 
the effects of vouchers. 

II, Findings and Conclusions 
OF THE Report 

The new report is very heavily grounded on 
the analysis and results of a 2008 study So- 
bel and King, which is discussed later in this 
review. The report extrapolates the results of 



http://epicpolicv.org/thinktank/Review-How-School-Choice 



1 of? 



that earlier study to five poor, rural counties 
of South Carolina (Clarendon, Hampton, 
Lee, Marlboro and Williamsburg). It also 
makes additional assumptions, also dis- 
cussed below, in order to analyze what the 
presence of voucher programs would mean 
for job creation and small business in these 
counties. His results can be summarized 
through the two following quotations: 

In total, a voucher-based school 
choice program in the counties of 
Clarendon, Hampton, Lee, Marlboro 
and Williamsburg could have gener- 
ated an additional 379 jobs by creat- 
ing 123 new businesses over the pe- 
riod 2000-2008 (p. 7) 

Among businesses with 5 to 9 em- 
ployees, 36 firms would have been 
created, generating 231 jobs. In 
businesses with fewer than 5 em- 
ployees, the five counties would 
have seen the creation of 87 small 
businesses. On average, businesses 
in this group have 1.7 employees, 
meaning these firms would have 
created 148 new jobs (p.7). 



Ill, The Report’s Rationale for its 
Findings and Conclusions 

In the 2008 report that Larson relies upon, 
Sobel and King analyze whether youth en- 
trepreneurship rates are higher in counties 
that have voucher programs.^ They include 
school voucher programs and charter 
schools separately in their regression mod- 
els. Voucher programs are found to create 
higher rates of youth entrepreneurship — one 
percentage point higher — ^while the charter 
schools do not, relative to traditional public 
schools. 

There are five important areas of concern 



about the methodology and findings re- 
ported in Sobel and King’s article. 

Unexplained Independent Variables. The two 
key independent variables — dummy va- 
riables for counties that had implemented 
school voucher programs by 1990 and had 
charter schools by 1995 — need significantly 
more explanation. In particular, the number 
of counties that had a school voucher pro- 
gram by 1990 is likely to be exceedingly 
small. The authors refer to some important 
voucher programs in footnote 4 — including 
Vermont, Maine, Florida, Milwaukee, Wash- 
ington, D.C., and Utah. But of these, the pro- 
grams in Florida, Washington, D.C., and 
Utah were all implemented after 1990; hence 
their effects would not be captured in the 
competition variable used by the authors. The 
Milwaukee voucher program was officially 
implemented in 1990. But as Chakrabarti 
(2008) shows, the competitive effects of the 
program on public schools in Milwaukee dur- 
ing the first phase (1990-1997) were small. ^ 

The cases of Vermont and Maine are a little 
different. These are old programs. For over a 
century these two states have had what are 
known as -tuitioning” programs. These pro- 
grams provide a voucher to students in small 
towns that do not have local schools at their 
grade levels; students may use these vouch- 
ers at a school of their choice — either public 
schools in nearby towns, or nonreligious 
private schools in-state or even out-of-state. 
These vouchers are only available to a small 
number of students. 

It is certainly possible that the public school 
systems close to those small towns are sig- 
nificantly affected by competition for tui- 

o 

tioning students. But lessons drawn from 
these unique programs and circumstances 
may have limited applicability to other areas 
and programs. In this regard, it is interesting 
to note that the Milwaukee program is often 
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called the nation’s -eldest voueher pro- 
gram,” by advoeates of vouchers among 
others, in the sense that it is the first modern 
program 

Given the above, it appears that the study 
may have been based only on a small, young 
voueher program in Milwaukee, plus the 
older tuitioning programs in Vermont and 
Maine. In any ease, readers of the article 
eannot determine what other counties might 
have voucher programs already in place by 
1990 or the nature and seale of sueh pro- 
grams. 

Weaknesses of the Cross-sectional Data. 
The eross-seetional nature of the data that 
Sobel and King use seems ill-suited to an- 
swer their eausal research questions. They 
contend that vouehers improve entrepre- 
neurship in areas where they exist. But even 
setting aside the other concerns raised here, 
the eausal relationship may be in the oppo- 
site direction; more entrepreneurial areas are 
more likely to adopt voucher programs. 
Though they argue that they ean rule out re- 
verse eausality, their diagnostie cheek is 
only suggestive. 

Consider Table 1 and Table 2 in the Sobel 
and King artiele, showing that counties hav- 
ing higher self-employment rates also have 
lower median household ineomes (with 
eoeffieients that are significant across all 
specifications) and sometimes have higher 
unemployment rates. This illustrates the pit- 
falls of drawing policy conclusions from 
simple cross-sectional data with limited con- 
trols. The sort of questionable assumptions 
and assertions made by Sobel and King 
might in this case lead one to argue (again 
without substantial basis) that self- 
employment leads to lower median house- 
hold incomes. It is possible that self- 
employment rates are driven by lack of ade- 
quate alternative employment opportunities 



rather than by innovative ideas and entre- 
preneurial synergies. Without more informa- 
tion on the earnings of these self-employed 
people and more details on the job market 
conditions in these respeetive eounties, it is 
diffieult to say whether it is the pull-in force 
of starting new businesses or the push-up 
force of lack of alternate jobs that lead these 
young people to be entrepreneurs. Aeeor- 
dingly, the cross-seetional dataset used here 
is simply insufficient, and bias from omitted 
variables is significant concern. 

Assumptions about Entrepreneurship and 
Growth. None of the studies that Sobel and 
King mention regarding the positive effeets 
of entrepreneurship on growth'' have ever 
been published in peer-reviewed academic 
journals, so it is difficult to ascertain the va- 
lidity and robustness of these findings. Other 
key researeh, condueted for a panel of 
OECD eountries, finds no evidenee linking 
increases in the self-emplowent rate to in- 
ereased economic growth. ^ Further, while 
the number of self-employed is a possible 
yardstiek of entrepreneurship — as statistieal 
information is often available along the 
ownership dimension — this yardstiek can 
sometimes be misleading: a relatively high 
number of self-employed people can either 
express a high level of entrepreneurship or 
merely refieet a time lag in eeonomie devel- 
opment (regions beginning to develop have 
typically higher rates of self-employment 
eompared to regions that are already devel- 
oped).'^ 

Poor Match between Counties and Districts. 
Sobel and King use eounty-level data on 
youth self-employment from the 2000 U.S. 
Census. It is worth mentioning that counties 
and sehool distriets do not share the same 
boundaries for most U.S. states, with the ex- 
ceptions being mainly in the South. Mil- 
waukee County, for instanee, ineludes not 
just Milwaukee Public Schools, which has a 
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voucher program, but 17 other (non- 
voucher) districts/"^ Often the number of 
school districts in a county is even larger, as 
in states with more than 500 school districts, 
such as California, Michigan, New York, 
New Jersey, and Texas. If sehool districts 
with and without voucher policies co-exist 
within the same county, this may introduce 
serious bias in the results. And this is likely 
to be the case since voucher programs, at 
least in 1990, were only eoncentrated in a 
few school districts. 

IV, The Report’s Use of 
Research Literature 

The Larson report’s use of research literature 
is sporadic and selective. The only directly 
relevant study on this particular question is 
that by Sobel and King (2008) referred to ear- 
lier. The significant omissions in that study 
make its findings unreliable, however. The 
Larson report’s deference to that study, in- 
cluding its unquestioned aeeeptanee of the 
main coefficient estimates and transposing 
them to a particular state and locale, makes 
its findings of little practieal value. 

The report also cites, in its concluding sec- 
tion, several studies to support the proposi- 
tion that vouchers improve student achieve- 
ment. While some studies on the effect of 
attending ehoiee sehools do indeed find pos- 
itive effeets on student performance, some 
other studies — equally sophisticated and 
published in peer-reviewed journals — do 
not. The author tends to ignore the latter 
group, eontending instead that the eduea- 
tional benefits of vouehers are -widely do- 
cumented” (p. 1). 

V, Review of the Report’s 
Methods 

Since the report unquestioningly applies the 
results from the Sobel and King (2008) 



study, the shortcomings of the methodology 
in that earlier study, as discussed above, 
equally undermine this new report. But there 
are three additional concerns. 

Failure to Consider Demand. The report 
puts too much emphasis on the supply side 
of the eeonomy, implicitly arguing that en- 
trepreneurship will ereate its own demand 
and jobs. However, as the author himself 
notes, -the state’s eeonomy grew 0.7 pereent 
more slowly per year than the national aver- 
age for states,” and ^ural counties did even 
worse” (p. 2). Further, between 2000 and 
2005, private employment declined in South 
Carolina as a whole by 1 pereent (p. 4). Un- 
der sueh cireumstances, the results of the 
Sobel and King study, even if valid for the 
eountry as a whole (which is debatable), 
may not hold for a state like South Carolina 
whieh is lagging behind in generating pri- 
vate employment opportunities. 

Unsupportable Multiplier Effect. The report 
extrapolates the findings of the Sobel and 
King study even further, by assuming that 
self-employment or entrepreneurship — two 
terms that the report uncritieally chooses to 
use synonymously — has a multiplier effeet 
in terms of the number of people employed. 
That is, Sobel and King find that voucher 
programs increase entrepreneurship rates by 
about 1 person out of 100 (from a base of 
about 4, so this translates to about a 25 per- 
eent inerease). But this report stretehes it 
further by assuming that these newly self- 
employed people would operate as small 
businesses and generate employment poten- 
tial similar to existing small businesses in 
the state (with a separate analysis, using the 
same methodology, for those employing be- 
tween 1 and 4 employees and those employ- 
ing between 5 and 9 employees). That is, the 
report assumes that small businesses would 
expand by 25 pereent due to voucher pro- 
grams, and that these will employ people at 
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the same rate as existing small businesses of 
the same size. This is a non sequitur. Among 
other things, new small businesses are un- 
likely to generate the same employment 
prospects as existing, older ones, since the 
latter have — by definition — been in the 
business for a while. 

Concerns about External Validity. The So- 
bel and King results are for the U.S. as a 
whole. Even setting aside the data and ana- 
lytic problems noted above, those results are 
unlikely to hold exactly for a particular state, 
and even less likely to hold for an unrepre- 
sentative five, poor rural counties within that 
state. 

VI, Review of the Validity of the 
Findings and Conclusions 

As pointed out above, the report not only 
relies on an earlier study (Sobel and King, 
2008) which is significantly flawed. It also 
introduces its own untenable assumptions 
while extrapolating the results from the ear- 
lier study to South Carolina and its poor, 
rural counties. The results of such an exer- 
cise are highly unlikely to yield valid con- 
clusions. Note also that if voucher programs 
are really successful in improving academic 
performance of students attending these 
schools, then this should be most apparent in 
terms of more immediate outcomes such as 
increases in test scores, college attendance 
and college completion. Outcomes such as 
youth employment and entrepreneurial rates 
could conceivably also result, but only at a 
later date. It is interesting to note that as yet 
there is no consensus in the literature even 
on the positive effects of school vouchers on 
academic performance of children using 
them. (The most recent evaluation of the 
Washington, D.C., school voucher program 
found some significant positive effects, but 
only after the third year of attending a 



voucher school, while the recent evaluation 
of the Milwaukee voucher program, unlike 
earlier ones, found no statistically significant 
effects.'^) Given the contradictory findings 
of the overall body of research concerning 
the immediate outcomes, readers would 
have good reason to be cautious about the 
claims made here about more indirect out- 
comes. 

It is also not obvious that, if indeed entre- 
preneurial rates are affected, they would be 
in the same county: only a fraction of people 
who attend school in a given county settle 
down in the same county as adults. In fact, 
studies have found that college-educated 
people are more likely to settle down in the 
state in which they attended college rather 
than the one in which they grew up.'^ This 
reality would not be captured in the empiri- 
cal framework that the authors rely on — 
regressing self-employment rates of youth 
aged 16-25 or 16-30 on prevalence of 
voucher programs in the respective counties. 

VII, Usefulness of the Report 
FOR Guidance of Policy 
AND Practice 

The rhetoric of the report and the approach- 
es used suggest a clear goal of championing 
a positive effect of voucher programs, with 
little or no concern for providing a careful 
analysis of the question at hand. This is- 
sue — ^whether voucher programs can stimu- 
late job creation via increased youth entre- 
preneurship — is of some potential interest. 
However, the report’s methodology is com- 
pletely inadequate for the purpose, and the 
report’s significant biases and omissions un- 
dermine the potential for valid findings. The 
report does not further our understanding of 
the issue at hand and is of little, if any, help 
in guiding policymakers, educators or the 
public. 
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